Structured Generation
- XGrammar
- context-free grammar is flexible but brings overhead
- XGrammar accelerates context-free grammar execution by dividing the vocabulary into
-
- context-independent tokens: that can be prechecked and
-
- context-dependent tokens: that need to be interpreted during runtime
-
- dottxt-ai/outlines
- lark: parse any context-free grammar